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(54) Multi-resolution geometry 

(57) A system, method, and apparatus is disclosed 
for creating a three-dimensional visual representation of 
an object having multiple resolutions by retrieving a ver- 
tex list for the object, determining a collapse order for 
the vertices identified in the vertex list, reordering the 
vertices identified in the vertex list responsive to the 
determined collapse order, and creating a vertex col- 
lapse list responsive to the collapse order, where the 
vertex collapse list specifies, for a target vertex, a neigh- 
bor vertex to collapse to. The vertex list may comprise 
3D coordinates of vertices without referring to other ver- 
tex attributes or, in alternate embodiments, the vertex 
list may refer to other vertex attributes such as colors or 
normals. A runtime manager is disclosed which dynam- 
ically manages the polygon counts for objects and 
frames based upon the location, velocity, and area of 
the object. Polygon counts are also adjusted based 
upon a target frame rate and a target polygon count. A 
system is also disclosed for continuous transfer of data 
across a remote connection in which different levels of 
resolution are transmitted individually. 
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Description 

DESCRIPTION OF THE RELATED ART 

1. Field of the Invention 5 

[0001 ] This invention relates to the field of generating 
three-dimensional graphics; more specifically, to the 
field of generating multiple resolutions of an object in a 
three-dimensional environment. 10 

2. Background of the Invention 

[0002] Realistic three-dimensional object rendering 
for use in games and other software applications has is 
been the goal for software and hardware makers in the 
computer industry for years. However, numerous prob- 
lems prevent the achievement of realistic three-dimen- 
sional object rendering on a typical user's home 
computer. 20 
[0003] Three-dimensional graphics use polygons to 
create the object to be rendered. These polygons are 
created and manipulated to portray curvature and 
details of the object. The more polygons used to create 
an object, the more detailed and realistic an object will 25 
appear. However, the more polygons used to create an 
object, the more computations required to render the 
object, thus slowing down the speed at which the object 
is rendered. Thus, there is a tradeoff from the devel- 
oper's standpoint between speed and realism. 30 
[0004] The resolution of this problem is not easy. As 
most users do not have the latest, most powerful per- 
sonal computer, the developer must design the objects 
for the lowest common denominator if the developer 
wants to reach the greatest number of potential users 35 
for the product. Thus, the developer must assume the 
user's processor is slow and is therefore capable of only 
rendering a small number of triangles per second. 
Therefore, the developer, when making the tradeoff 
described above, must favor the speed side of the equa- 40 
tion, and design objects with fewer triangles than if 
faster machines were being used by all users. This solu- 
tion, however, pleases neither the user with a low-end 
computer nor the user with the high-end computer. The 
user with the low-end computer will most likely still have 45 
images which are slow and choppy, because the devel- 
opers are unwilling to completely sacrifice realism, and 
the user with a high-end computer will have images 
which appear artificial and robotic because the applica- 
tion is not designed to take advantage of the high-end so 
machine's greater processing power. In fact, on some 
high-end systems, the application will be too fast to play 
or interact with because the polygon count is too low. 
[0005] Another problem facing the developer is the 
fact that the same object requires more detail when ss 
closer to the screen than it requires if it is in the back- 
ground. When an object is closer to the screen, the 
angles and straight edges of the polygons comprising 



the object can be seen more clearly. At this point, more 
polygons are needed to smooth the angles and con- 
tinue the realistic rendering of the object. However, the 
most detailed version of the object cannot always be 
used to render the object because the application will 
require too much computing power to quickly and 
smoothly render images on the screen. In order to 
achieve smooth 3D animation, the processor must 
render 3D objects at 20 to 60 frames per second. If too 
many polygons are used for each object, thus providing 
the necessary realism for the object when it is close to 
the screen, then the processor will not be able to 
achieve the above minimum frame rate required for 
smooth rendering. 

[0006] One solution to allow realistic rendering of 
three-dimensional objects while also limiting the 
number of polygons on the screen is to use Level of 
Detail mapping. Level of Detail mapping provides differ- 
ent levels of resolutions of an object based upon the dis- 
tance of the object to the screen. In order to create the 
different levels of detail, the developer must create dif- 
ferent versions of the object for each level required. Typ- 
ically, only three or four levels are used because storage 
of multiple versions of each object to be rendered can 
consume too much of the user's system resources. 
[0007] There are several drawbacks to the level of 
detail methodology. First, this method has a large 
impact on system resources, as described above. Each 
object now requires three or four times more storage 
space than previously required to store each version of 
the object. Each level requires a separate vertex list as 
well as a separate data structure. Second, when transi- 
tioning from one level to another, an effect known as 
object popping occurs. The higher detailed version of an 
object is abruptly rendered as the object moves towards 
the screen, and "pops" out at the viewer, ruining the 3D 
immersive qualities of the application. The level of detail 
method also requires extra authoring of each version of 
the object, requiring more time from the developer. 
Level of Detail also does not address the lowest com- 
mon denominator problem described above. The high- 
est level of detail of each object must be created in 
consideration of the user with an inefficient computer 
who will be using the application. Thus, the highest level 
of detail cannot contain too many polygons or the image 
will appear slow and choppy on the low-end user's com- 
puter. Again, this image will also appear angular and 
robotic on the high-end user's computer, as it does not 
take advantage of the high-end computer's greater 
processing power. 

SUMMARY OF THE INVENTION 

[0008] In accordance with the present invention, an 
apparatus, system, and method is disclosed for produc- 
ing realistic rendering of a 3D object while minimizing 
the use of user system resources and maximizing fidel- 
ity without sacrificing speed. The invention produces a 
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continuous level of detail of an object using vertex merg- 
ing responsive to the location of the object on the 
screen and other factors, thus eliminating the object 
popping effect. As the object moves towards the back- 
ground, and therefore requires less polygons in order to 5 
provide a realistic rendering, vertices of the object are 
merged together in a manner designed to cause the 
least visual distortion. As the vertices are merged, poly- 
gons within the object are eliminated, thus lowering the 
polygon count of the object continuously as it moves far- 10 
ther and farther away from the screen. As an object 
moves towards the screen, vertices are added to the 
object, adding polygons to the object and thus providing 
a more realistic representation of the object as it grows 
close to the user and fine details become necessary. 15 
Thus, at any given moment, every object on the screen 
only has as many polygons as is required to provide a 
realistic rendering of the object. No polygons are being 
unnecessarily drawn, and thus optimum use is being 
made of the user's system. No object-popping effects 20 
are created as polygons are added or removed from the 
object on a continual basis based on the object's move- 
ment in the 3D environment. 

[0009] Additionally, the invention requires only one 
version of the object to be authored and stored on the 25 
user's system, thus minimizing the impact on system 
resources. One vertex list is used which preferably 
specifies the highest level of detail, and the system in 
accordance with the present invention is able to then 
generate the continuous level of detail of the object for 30 
display on the screen. Also, the system advantageously 
increases and decreases the resolution of the objects 
on the fly. Thus, as only the current level of detail being 
displayed is stored, minimal use of memory is required. 
By storing certain minimum information which is deter- 35 
mined prior to run-time to guide the resolution changes, 
the resolution changing is performed at run time at opti- 
mal speed. Another benefit of the present invention is its 
ability to allow a developer to tweak the vertex merging 
in accordance with the developer's own preferences. 40 
Finally, the invention automatically adjusts the amount 
of polygons in a screen responsive to the capabilities of 
a user's system, providing an optimal image for every 
user. In one embodiment, the invention monitors the 
system to determine the frame rate at which the frames 45 
are being rendered, and adjusts the total amount of pol- 
ygons allowable on the screen at one time accordingly. 
[0010] Additionally, a target frame rate may be set, 
which allows the user to specify the speed at which the 
scenes should be rendered. The present invention then so 
dynamically adjusts the total amount of polygons to 
ensure the frame rate is maintained. Alternatively, the 
invention allows a polygon count to be specified, and 
then ensures that this amount of polygons is always on 
the screen, regardless of the frame rate. 55 
[0011] In a preferred embodiment, a three-dimen- 
sional visual representation of an object having multiple 
resolutions is created by retrieving a vertex list for the 



object, determining a collapse order for the vertices 
identified in the vertex list, reordering the vertices iden- 
tified in the vertex list responsive to the determined col- 
lapse order, and creating a vertex collapse list 
responsive to the collapse order, where the vertex col- 
lapse list specifies, for a target vertex, a neighbor vertex 
to collapse to. The vertex list may comprise 3D coordi- 
nates of vertices without referring to other vertex 
attributes or, in alternate embodiments, the vertex list 
may refer to other vertex attributes such as colors or 
normals. 

[0012] More specifically, in a preferred embodiment, 
the collapse order of the object is determined by deter- 
mining an optimal collapse path from the set of collapse 
paths, computing visual distortion factors for the 
selected collapse path, determining a collapse value for 
the selected collapse path, repeating for each path in 
the set of collapse paths, comparing the collapse values 
to determine a collapse path causing a least visual dis- 
tortion to the object, selecting a next vertex to be col- 
lapsed, collapsing the object along the selected path, 
and repeating until a minimum resolution level is 
attained. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0013] 

Figure 1a is a block diagram of a preferred embod- 
iment of a computer system in accordance with the 
present invention. 

Figure 1b is a block diagram of a preferred embod- 
iment of a modular distributed architecture compu- 
ter system in accordance with the present 
invention. 

Figure 2a illustrates an overview of a preferred 
embodiment of creating a collapse order list in 
accordance with the present invention. 

Figure 2b illustrates a first instance of an object 
prior to having a vertex collapsed. 

Figure 2c illustrates the object of Figure 2b after 
having a vertex collapsed in accordance with the 
present invention. 

Figure 2d illustrates an object at a lower resolution. 

Figure 2e illustrates the object of Figure 2d with a 
vertex added. 

Figure 3 is a more detailed diagram of a preferred 
embodiment of determining a collapse order in 
accordance with the present invention. 

Figure 4 is a more detailed diagram of a preferred 
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embodiment of determining a set of collapse paths 
in accordance with the present invention. 

Figure 5 is a more detailed diagram of a preferred 
embodiment of selecting a collapse path in accord- 
ance with the present invention. 

Figure 6 is a more detailed diagram of a preferred 
embodiment of computing visual distribution factors 
in accordance with the present invention. 

Figure 7 is a more detailed diagram of a preferred 
embodiment of determining a collapse value for a 
selected collapse path in accordance with the 
present invention. 

Figure 8 illustrates an alternate embodiment of a 
preferred embodiment of determining a collapse 
order in accordance with the present invention. 

Figure 9 illustrates an alternate embodiment of 
determining a set of collapse paths in accordance 
with the present invention. 

Figure 10 is a flow chart illustrating a preferred 
embodiment of the runtime manager in accordance 
with the present invention. 

Figure 11 is an alternate embodiment of the runt- 
ime manager in accordance with the present inven- 
tion. 

Figure 12 illustrates embodiments of analyzing the 
optimal collapse level of an object in accordance 
with the present invention. 

Figure 13 illustrates an embodiment of the present 
invention for use in the remote transfer of data. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0014] Figure 1a illustrates a preferred embodiment of 
a computer system 100 in accordance with the present 
invention. System 100 is typically implemented on a 
computer system 100 such as a personal computer 
having an Intel Pentium™ processor and running the 
Windows™ 95 operating system from Microsoft Corpo- 
ration. ROM 112 is read-only memory for storing data 
having unvarying functionality. Disk 124 stores data of 
which immediate access is not required, for example, 
the operating system module, databases, and other 
modules. In a one embodiment, as used by a developer 
166, disk 124 stores a vertex list generator module 138, 
a collapse path determiner module 142, a collapse 
value analyzer module 146, a collapse path selector 
module 150, vertex lists 158 and a collapse list 154. In 
an embodiment used by a user 170, disk 124 stores 



applications, run time manager 162, and collapse lists 
154. When access to the stored modules is required, 
the modules are moved to RAM 108, which stores data 
of which more immediate access is required. A display 
5 120 and input device 1 16 are connected to the proces- 
sor 104 through bus 118 and allow a user 170 or a 
developer 1 66 to interact with the modules stored in disk 
124. 

[0015] In Figure 1b, a distributed architecture imple- 

10 menting a preferred embodiment of the present inven- 
tion is illustrated. A vertex list generator 180, comprising 
an application specific integrated circuit (ASIC) coupled 
to a memory, generates vertex lists 158. The vertex lists 
158 are transmitted to a collapse path determiner 184 

15 which determines collapse paths from the received ver- 
tex lists 158. The collapse path data is transmitted to a 
collapse value analyzer 188, which analyzes the col- 
lapse path data to determine collapse values for each 
collapse path. These values, along with the paths them- 

20 selves, are transmitted to the collapse path selector 
192, which selects a collapse path from the list of verti- 
ces which, if the object is collapsed along the selected 
path, causes the least visual distortion to a viewer 
watching the collapse. This selected path is stored in 

25 the collapse list memory 194, and the new set of verti- 
ces is generated by the vertex list generator 138 
responsive to the selected collapse path. The system 
continues to generate and select collapse paths until 
the vertex list generator no longer has any vertices 

30 remaining from which to generate a list, and the 
processing of the system is thus complete. The final col- 
lapse list is transmitted from the collapse list memory to 
the processor 104 of the developer's computer 100. 
[0016] The data source 196 stores the original vertex 

35 list for processing. Data sources include the application 
requesting the object modeling, or a secondary source 
which stores objects requiring modeling in accordance 
with the present invention. In one embodiment, the 
modules 138, 142, 146, 150 are implemented as a set 

40 of Field Programmable Gate Arrays, and are pro- 
grammed to perform the separate functions described 
above. By compartmentalizing the separate functions in 
a distributed architecture, faster and more robust 
processing is achieved. 

45 [0017] Figure 2a illustrates the processing of a pre- 
ferred embodiment of the present invention for generat- 
ing collapse orders. A vertex list 158 is retrieved 200. 
Typically, vertex lists 158 are provided by the developer 
1 66 for each object the developer 1 66 would like to have 

so modeled. The vertex list 158 may contain indices into a 
3D coordinate map, or the vertex list 158 may index into 
other maps, such as texture maps, or normal maps. The 
vertex list 158 is usually "cleaned" prior to being proc- 
essed. Typically, vertex lists 158 may specify triangles 

55 having edges close to one another but which do not 
actually overlap. Without performing any cleaning oper- 
ations, these close edges cause the triangles they are a 
part of to be considered as two separate polygons, 



4 



7 



EP 0 965 948 A2 



8 



which may cause holes or cracks to appear at lower res- 
olutions of the model. Thus, the system looks for redun- 
dant vertex data in the vertex list and eliminates the 
redundancies. 

[001 8] The vertex list 1 58 may specify a maximum set 
of vertices used in the object, or a maximum and a min- 
imum set of vertices in the object. The minimum set of 
vertices is specified by the developer 166 to define a 
minimum quality level the object may not be collapsed 
beyond. As more vertices are collapsed in an object, the 
less realistic the object appears if examined closely. 
Therefore, for some objects the developer 166 may 
decide that there is a point beyond which the object is 
no longer recognizable as its true shape, even though 
the object at that point is very small on the screen and 
therefore does not require many polygons to specify 
sufficient detail. For these objects, the developer 166 
specifies a minimum set of vertices to which the object 
may be collapsed. The system identifies these vertices 
during its processing, and does not collapse those ver- 
tices in the object. The vertex list 158 may also specify 
a nested set of vertex sets that represent progressively 
lower resolutions of the object. In this case the system 
generates a collapse list that interpolates between the 
nested vertex sets. 

[001 9] After the vertex list has been retrieved, the sys- 
tem proceeds to determine 204 a collapse order. The 
collapse order of an object is specifies the order in 
which individual vertices are merged into other vertices. 
Vertices are collapsed along collapse paths, with the 
goal of causing the least visual distortion possible for 
the object. For example, as shown in Figure 2b, an 
object is shown having multiple vertices, three of which 
are specified as V1 , V2, and V3. If the system in accord- 
ance with the present invention determines that the first 
collapse path is to collapse V1 to V2, the object as 
shown in Figure 2c results. The object in Figure 2c has 
less polygons to render than the object in Figure 2b. 
Thus, the object in Figure 2c is of lower resolution than 
the object in Figure 2b, and should be displayed when 
the object is located closer to the background or due to 
other factors described in greater detail below, when 
added resolution is most likely to go unnoticed by the 
user 170. By displaying a version of the object which 
contains less polygons while it is closer to the back- 
ground, the processor is able to devote more time to 
process objects which are closer to the foreground. This 
allows the objects in the foreground to have higher pol- 
ygon counts without impacting on the frame rate. 
[0020] After determining a collapse order for the 
object, the vertex list 158 is reordered 208 into the order 
specified by the collapse order. The vertex to be col- 
lapsed first is identified and the other vertices are 
sequenced accordingly based on their collapse priority. 
The system advantageously minimizes its footprint in 
memory by using the existing vertex list 158, instead of 
using another construct to store this information. Next, 
the system creates 212 a vertex collapse list 154. This 



list specifies the vertex to which the target vertex is to be 
collapsed; alternatively, the list specifies the vertices to 
which to connect an added vertex. When collapsing ver- 
tices in an object to achieve a lower resolution, the sys- 

5 tern may simply eliminate vertices as ordered in the 
vertex list until the desired resolution is obtained. How- 
ever, in order to increase the resolution of the object by 
adding vertices, more information is needed. In each 
case, a correct triangle list must be generated by the 

10 system at the desired resolution. The triangle list speci- 
fies connectivity information regarding all of the trian- 
gles which must be rendered to achieve a given 
resolution. 

[0021] For example, as shown in Figure 2d, an object 

15 is in a first, lower resolution state. In Figure 2e, a vertex 
is added to the object to increase the number of poly- 
gons and thereby increase the resolution of the object. 
However, as is shown, without more information, the 
system does not know which vertices to connect to the 

20 new vertex. Thus, more information is stored in a vertex 
collapse list 154. The vertex collapse list 154 stores the 
connectivity information for the neighbor vertices to 
which each vertex is connected. In the example of Fig- 
ure 2d and 2e, the vertices to which to connect V1 are 

25 also specified in the vertex collapse list 154, and thus 
the system knows the correct edges to draw. Using the 
connectivity information, a correct triangle list is gener- 
ated for each resolution. In a preferred embodiment, the 
information regarding the two lists 154, 158 are stored 

30 in the same location to optimize processing. The term 
list is used descriptively, as arrays and other data struc- 
tures are preferably used to store the collapse informa- 
tion. 

[0022] Figure 3 is a more detailed diagram of a pre- 
35 ferred embodiment of determining a collapse order in 
accordance with the present invention. First, a set of 
collapse paths is determined 300. A set of collapse 
paths identifies every possible collapse path between 
each vertex and every other vertex to which it is con- 
40 nected, at the current resolution of the object. Thus, in 
the object of Figure 2b, there are 1 1 vertices (V1-V1 1). 
For V2, four potential collapse paths (C1, C2, C3, C4) 
may be identified. 

[0023] Next, a collapse path from the set of collapse 
45 paths is selected 304. Visual distortion factors are com- 
puted 308 for the selected collapse path. Visual distor- 
tion factors are measurements of the effect of a given 
collapse on the object. Some collapse paths will have a 
much greater visual effect on the user than others. For 
so example, if V1 is collapsed to V2, the object will appear 
to shrink noticeably in width. However, if V8 is collapsed 
to V1 1 , the object will not appear as distorted to the 
user. The system preferably captures these distinctions 
by computing several visual distortion factors, including 
55 area change, angular deviation, and local volume 
change, described in greater detail below. 
[0024] Each collapse path is given 312 a collapse 
value as a function of the computed visual distortion fac- 
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tors for that path. The collapse value is preferably a 
weighted combination of the visual distortion factors for 
the path. Weighting the different factors allows the 
developer 166 to specify the importance of the factors 
as applied in the particular application being developed. 5 
[0025] The system determines 31 6 whether there are 
more collapse paths. If there are more collapse paths, a 
next path is selected 304 and the process described 
above is repeated. If there are no more collapse paths, 
the system compares the collapse values of the col- 10 
lapse paths to determine 220 a collapse path which 
causes the least visual distortion to the object. 
[0026] The vertex to be collapsed is identified 324 
responsive to the determined collapse path, and a col- 
lapse priority is assigned 326 to the vertex to be used 15 
upon reordering the vertex list. The object is collapsed 
328 along the collapse path. The system determines 
332 if there are more than one vertex not in the mini- 
mum point set remaining. If there are not, the system 
then moves to reordering the vertex list 1 58. If there are 20 
more than one vertex remaining, the system repeats the 
above process, treating the collapsed object as a new 
object to be processed. The system processes the 
object until a set of collapse paths are determined which 
cause the least visual distortion to the object, and 25 
reduce the object from a maximum resolution to a mini- 
mum resolution. For each collapse path stored, the ver- 
tices to which the target vertex is connected, and the 
change in connectivity as expressed by the triangle list 
are stored. When the vertex is added to the object, this 30 
allows the system to know which other vertices are con- 
nected to the added vertex by which triangles. This 
information is stored in the vertex collapse list 154, as 
described above. 

[0027] Figure 4 illustrates an alternate embodiment of 35 
the method of determining a set of collapse paths. A tar- 
get vertex is selected 400. Any one of the existing verti- 
ces of the object may be selected; order does not 
matter. Next, an input is received 404 which specifies 
the maximum of neighbor vertices to examine for each 40 
vertex. This allows a developer 166 to control the 
processing time of the system. By limiting the number of 
neighbor vertices which may be examined by the sys- 
tem for each vertex, the system does not have to per- 
form as many calculations. 45 
[0028] Next, a neighbor vertex is identified 408. A 
neighbor vertex is a vertex connected along an edge to 
the target vertex. A neighbor vertex would include any 
vertex directly connected to the target vertex, as well as 
any vertex which is connected to the target vertex so 
through another vertex or vertices. As can be imagined, 
this list may grow very large if every vertex is processed. 
However, as described above, a maximum number of 
neighbor vertices may be specified to minimize 
processing. 55 
[0029] After identifying a neighbor vertex, a collapse 
path is determined 412 between the target vertex and 
the neighbor vertex. The system determines 416 



whether the maximum number of collapse paths have 
been reached. If it has, the system determines 420 
whether there are more vertices. If there are more verti- 
ces, the collapse paths for the other vertices are com- 
puted as described above. If there are no more vertices, 
the system selects 304 a collapse path from the set of 
collapse paths. 

[0030] Figure 5 illustrates one embodiment of select- 
ing a collapse path. In this embodiment, processor com- 
putations are minimized by limiting the number of 
collapse paths which are to have collapse values. For 
the first iteration through the object, collapse values are 
computed for every collapse path. After collapse path is 
selected, the object is collapsed along the path. A new 
set of collapse paths are generated as described above. 
However, in this iteration, collapse values are generated 
for those collapse paths which are within a predefined 
distance from the collapse path which was previously 
used to collapse the object. Many collapse paths will 
remain the same after the previous collapse, and their 
collapse values, i.e., the objective measurement of the 
visual impact of their collapse on the object, will also 
remain the same. 

[0031 ] For example, in Figure 2b, if C1 is chosen to be 
the collapse path, the Figure in 2c results. The collapse 
value for the path between V8 and V1 1 may remain the 
same in the two versions of the object because the ver- 
tices around V8 and V1 1 are not affected by the col- 
lapse of C1. Therefore, there is no need to recompute 
the collapse value for the V8-V1 1 path. By not comput- 
ing the visual distortion factors for every collapse path 
after every collapse, the computations of the system are 
greatly minimized, and the processing becomes much 
faster. 

[0032] Thus, as shown in Figure 5, the system deter- 
mines 500 whether a collapse path is within a threshold 
distance from the previous collapse path. The threshold 
may be preset or defined by the developer 166. The 
developer 166 may experiment with different thresholds 
to maximize accuracy while minimizing computations. If 
the collapse path is within the threshold, the system 
computes 308 visual distortion factors for the collapse 
path. If the collapse path is not within the threshold, the 
existing collapse value is continued to be used as the 
value for that path, and a next path is selected. 
[0033] Figure 6 illustrates three visual distortion fac- 
tors preferably computed in accordance with the pre- 
ferred embodiment of the present invention. First, the 
area change of the object is computed 600 in response 
to collapsing the object along the selected collapse 
path. The area change of the object is computed by 
computing the surface area of the object prior to the col- 
lapse, and then computing the surface area of the 
object after the collapse. Subtracting the difference 
between the two areas indicates the effect on the sur- 
face area of the object performing the collapse will have. 
Next, the angular deviation is computed 604 in 
response to collapsing the object along the collapse 
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path. Angular deviation measures the effect on the local 
curvature of the object the collapse will have. The sys- 
tem calculates normals of the triangles of which the ver- 
tex is a part. Points which represent high curvature are 
more important to the visual appearance of an object. 
Thus, these points are assigned a measure which low- 
ers their collapse priority. Third, the local volume 
change is computed 608 in response to the collapse. A 
pyramid is created from the target vertex, using the tar- 
get vertex as the apex of the pyramid. The base of the 
pyramid is the triangle formed by three consecutive 
neighbor vertices. A sequence of these pyramids is con- 
structed from successive triples of neighbor vertices, 
and their volume is summed. The volume of the object 
is determined, the target vertex is collapsed along the 
collapse path, and the volume is computed again. The 
change in volume is used as an indication of the affect 
on the visual appearance of the object. Calculating 
pyramidal "local volume" change is much faster than 
calculating the "true" volume of an object, and more 
accurately accounts for the topology of an object. Other 
measures of visual distortion known to those of ordinary 
skill in the art may also be used in accordance with the 
present invention. Statistical measures of error such as 
surface deviation can also be used to compute visual 
distortion. 

[0034] Figure 7 illustrates an alternate embodiment of 
determining a collapse value for the selected collapse 
path. In this embodiment, the system receives 700 an 
input from the developer 166 specifying a priority weight 
for the different factors. The system multiplies 704 the 
factors by the specified priority weights, and then com- 
bines 708 the factors to obtain a collapse value. Allow- 
ing the developer 166 to specify the weights allows 
more creative control for the developer 166. The devel- 
oper 166 may decide that the object is very spiky, and 
therefore the angular deviation factor should be given 
the highest priority. The developer 166 would then spec- 
ify a high weight for the angular deviation factor. Those 
collapses which have a large angular deviation factor 
would be prioritized lower for collapsing. If an object rep- 
resents an organic shape, the local volume factor 
becomes more important. A developer 166 would spec- 
ify a higher weight for the local volume factor, and those 
collapse having a great effect on local volume would be 
prioritized lower. If the developer 166 does not specify 
weights, default values which evenly weight the factors 
are used. In one embodiment, the developer 166 is able 
to increase the speed of the processing of the system 
by eliminating factors from consideration. For example, 
the developer 166 may determine that local volume 
change is not relevant to a specific object. The devel- 
oper 166 then specifies that local volume change 
should not be computed for this object. The system is 
then able to process the object much faster. 
[0035] Figure 8 illustrates an alternate embodiment of 
the determining a collapse order step 204. This embod- 
iment allows the developer 166 to "tweak" the collapse 



order interactively. As the visual distortion of an object is 
essentially a subjective determination, the present 
invention beneficially allows the developer 166 to intro- 
duce their subjective preferences into how the object is 

5 collapsed. First, the set of collapse paths is determined 
800 as described above. Then, the object is displayed to 
the user at the current resolution level. If this was the 
first iteration, the object would be at the maximum reso- 
lution level. The system selects a collapse path ran- 

10 domly from the set of collapse paths, and the object is 
collapsed. The system displays the collapsed object to 
the developer 166, and the developer 166 can see the 
effect of the collapse on the object. If the developer 166 
approves of the collapse, the developer 166 selects the 

15 path. If the system receives 820 an input selecting the 
path, the system associates a collapse priority for the 
path based on the number of paths which have already 
been selected. If the developer 1 66 does not approve of 
the collapse, a next collapse path is selected and the 

20 process is repeated. 

[0036] In one embodiment, collapse values are calcu- 
lated for each path and the paths are prioritized as 
described above. The path designated to be collapsed 
first is chosen as the first path to be collapsed and dis- 

25 played to the developer 166. If the developer 166 
selects this path, the path retains its priority. A new set 
of collapse paths is generated and the highest priori- 
tized path from the new set selected for display to the 
developer 166. If the developer 166 does not select the 

30 path, the next highest prioritized path is selected and 
displayed to the developer 166. Of course, the devel- 
oper 166 may specify at any time a particular path the 
developer 166 sees in the object the developer 166 
wants collapsed. Such a selection by the developer 166 

35 overrides any previous prioritization by the system. 
[0037] Figure 9 illustrates an embodiment of the 
present invention in which a minimum vertex set is 
specified by the developer 166 prior to computing col- 
lapse paths. A minimum vertex set, as described above, 

40 is a set of vertices which the developer 1 66 does not 
want collapsed. Thus, as shown in Figure 9, after a col- 
lapse path is selected 900, the system determines 
whether the collapse path collapses a vertex specified 
in the minimum vertex set. If the vertex is on the mini- 

45 mum vertex set, the collapse path is not selected. 

[0038] In another embodiment, texture maps are 
indexed by the vertices. Texture maps provide texture 
for the mapped area, giving an object a realistic appear- 
ance. Textures for different triangles may be quite differ- 

50 ent. Therefore, when a triangle is collapsed, the system 
must determine the affect of the loss of the texture of the 
triangle on the appearance of the object. Vertices which 
are on the edges of texture discontinuities are not col- 
lapsed, because of the affect the collapse will have on 

55 the appearance of the object. Thus, when collapse 
paths are selected, the vertices in the path are exam- 
ined to determine if they are located on the edge of a 
texture discontinuity. If they are, the collapse path is not 
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selected. 

[0039] Figure 10 illustrates the run-time manager of 
the present invention. The run-time manager performs 
the adding and subtracting of polygons to and from the 
object as required during the real-time execution of the 
application. The run-time manager works in conjunction 
with the graphics system of the computer and the appli- 
cation program for which the objects have been proc- 
essed. Upon initiating the application, the manager 
collapses 1000 the objects referenced in the applica- 
tion. The manager stores 1004 extended vertex col- 
lapse information for each collapse level of the objects 
in a table. Extended vertex collapse information is the 
information stored in the vertex collapse list 154 speci- 
fying what vertex the each collapsing vertex will col- 
lapse to, as well as which triangles need to be 
eliminated from the model. By storing the extended ver- 
tex collapse information in the table, the processor is 
able to more quickly add and subtract polygons 
because the processor simply has to access the table to 
determine which vertices and triangles to add, subtract, 
or re-index and does not have to perform any demand- 
ing computations. 

[0040] In one embodiment, the extended tables for 
each object are already created in the development 
stage, and the tables are simply loaded into data mem- 
ory for easy access when the application is initiated. 
The runtime manager awaits a request from the applica- 
tion for a collapse level from an object. The original 
appearances of each object are represented in a default 
resolution. When the application or the graphics pro- 
gram requests 1008 an increased or decreased resolu- 
tion from the runtime manager, the runtime manager 
determines 1012 whether the requested resolution 
requires a collapse level greater than the current col- 
lapse level of the object. The current collapse level is 
known because the current collapse level of the object 
is the only version of the object which is stored in mem- 
ory. If the requested resolution requires a greater col- 
lapse level for the object, vertices are added to the 
object in accordance with the vertex collapse informa- 
tion in the table until the requested collapse level is met. 
This continuous addition of vertices provides for a 
smooth rendering of the object, and eliminates the 
object-popping problem discussed above. Similarly, if 
the requested resolution requires a collapse level which 
is less than the current collapse level, vertices are col- 
lapsed 1016 until the proper resolution of the object is 
achieved. The table allows for instantaneous addition 
and subtraction of polygons to the object upon request. 
The table also allows for a minimal memory footprint by 
the present invention as entire versions of the objects 
are not required to be stored. The continual addition or 
subtraction of polygons to an object eliminates the 
object-popping artifacts. Thus, in accordance with the 
present invention, an efficient, high-speed object mode- 
ling process is disclosed which provides multiple levels 
of resolution while minimizing resource use. 



[0041] Figure 11 illustrates an alternate embodiment 
of the runtime manager in which objects are analyzed to 
determine a collapse level. In this embodiment, the 
object is collapsed 1100 and vertex information is 

5 stored 1 1 04 for each collapse level, as described above. 
However, in this embodiment, the object is analyzed 
1 108 to determine an optimal collapse level. If the man- 
ager determines 1112 the optimal collapse level 
requires a higher resolution, vertices are added 1 120 to 

10 the object. If the optimal level requires a lower resolution 
than the current resolution, vertices are collapsed 1116. 
[0042] Figure 12 illustrates several methods for ana- 
lyzing the optimal collapse level of an object. One or all 
of these methods can be used in accordance with the 

15 present invention to determine an optimal collapse 
level. First, the velocity of the object is determined 1 200. 
The velocity of an object is determined by measuring 
the distance an object moved between the current 
frame and the last frame, and dividing by the time 

20 elapsed between frames. Alternatively, velocity is calcu- 
lated by measuring distance traveled over several of the 
most recently rendered frames and dividing by the total 
elapsed time of the rendering of the whole recent frame 
sequence. Next, the determined velocity is compared to 

25 a table which maps velocities of the object to collapse 
levels. This table may be specifically designed for a 
given object, or may be a global table which provides 
general correlations between velocity and collapse 
level. As an object increases in speed, it requires less 

30 resolution to render it realistically, as motion tends to 
blur the finer details in an object. Therefore, the object's 
current velocity is compared to the table to determine 
what resolution it requires at that speed. If the manager 
determines 1232 that the resolution required is a col- 

35 lapse level greater than its current collapse level, more 
polygons are added 1236 as described above. If the 
resolution the object requires is less than the resolution 
provided by the current collapse level, polygons are 
subtracted 1240 away. Thus, the runtime manager 

40 dynamically manages the resolution of the object to pro- 
vide optimal fidelity while minimizing the use of process- 
ing power. 

[0043] The projected area of an object is another fac- 
tor which is used by the runtime manager to determine 
45 an optimal collapse level for an object. The projected 
area of an object is the area which the object will occupy 
as rendered on the display. The greater the projected 
area of an object, the higher the resolution that is 
required. The system determines 1208 the current pro- 
se? jected area of the object, and compares 1212 the pro- 
jected area to a table which correlates projected area 
and collapse levels. The polygon count is then adjusted 
1232 accordingly. 

[0044] The present invention also provides for global 
55 polygon count management. In this embodiment, the 
user selects a target polygon count for each frame. In 
this embodiment, the system determines 1216 the 
number of polygons currently being displayed in a 
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frame. The total number of polygons displayed in a 
frame may be calculated by determining which objects 
are on screen and totaling the number of polygons in 
each object, or by having the renderer keep an internal 
tally of how many triangles it drew on screen in one 5 
frame. This number is compared 1220 to the predefined 
target polygon count. If the runtime manager deter- 
mines 1232 that the current polygon count is less than 
the target polygon count, more polygons are added 
1236. If the current polygon count is greater than the w 
target polygon count, polygons are subtracted 1240 
away. The determination of which objects to add and 
subtract polygons to and from may be made in a 
number of ways. Polygons may be added and removed 
uniformly to and from all polygons. Alternatively, objects 15 
may be individually analyzed and polygons added and 
subtracted on an individual basis. 
[0045] Alternatively, the user 170 is able to select a 
target frame rate. The manager determines 1224 a cur- 
rent frame rate by monitoring the processor clock and 20 
determining how long it is taking to render frames. The 
current frame rate is then compared 1228 to the target 
frame rate. If runtime manager determines 1232 that the 
current frame rate is faster than the target frame rate, 
polygons are added 1 236 to the frame to slow the frame 25 
rate down. If the current frame rate is slower than the 
target frame rate, polygons are subtracted 1240 from 
the frame to speed the frame rate up. Thus, the runtime 
manager allows for dynamic global polygon manage- 
ment requiring minimal input from the user 170. This 30 
management process allows the present invention to be 
platform universal, as if the invention is used on a sys- 
tem with a slower processor, the target frame rate or 
polygon count may be set lower, and the benefits 
described above are still provided. However, a system 35 
with a faster processor can be set to have a higher 
frame rate or polygon count, and the higher processing 
power of the system is maximized by the present inven- 
tion. 

[0046] The present invention may also be used to 40 
transmit data through remote connections, as illustrated 
in Figure 13. When receiving data over a remote con- 
nection, for example, the Internet, a user 170 is often 
waiting for data to download before a requested object 
may be displayed. In accordance with the present inven- 45 
tion, upon requesting an object over a remote connec- 
tion, the minimum vertex set, or the lowest collapse level 
of an object is transmitted to the user 170. This minimal 
resolution version of the object requires less data to rep- 
resent, and therefore is transmitted much faster to the so 
user 170. Then, the additional collapse levels are sent 
serially to the user 1 70 to increase the resolution of the 
object to its maximum resolution. As each collapse level 
typically adds only a few polygons, each collapse level 
is also transmitted very quickly. This method allows the 55 
user to receive a minimal version of the object very 
quickly, and then a full resolution later in time. If the user 
170 does not require a full resolution of an object, the 



user 1 70 does not have to wait for unnecessary data 
(higher resolution data) to be transmitted before the 
user 170 can see the object. Even if the user 170 
requires a higher resolution short of the maximum reso- 
lution, the present invention transmits the higher resolu- 
tions in packets which allows the user 170 to view the 
object in a shorter period of time than it would take to 
wait for the entire maximum resolution version of the 
object to download. 

[0047] As shown in Figure 13, a request is received 
1300 for an object across a remote connection. 
Responsive to this request, a minimal resolution of the 
object is sent 1304 to the requester. This minimal reso- 
lution of the object is the lowest resolution of the object 
which may be displayed and still accurately describe the 
object. If a minimal vertex set of the object has been 
specified by the developer 166, this set is used as the 
minimal resolution to be sent. Next, a packet of informa- 
tion which comprises the vertices required to increase 
the collapse level of the object to a next higher resolu- 
tion is sent 1308. This information comprises the verti- 
ces and the connections required to increase the 
resolution of the object, as described in detail above. 
Then, the system determines 1312 whether a maximum 
resolution or target resolution has been sent. If the 
packet which comprises the information required to 
increase the resolution of the object to its maximum res- 
olution has been sent, the system knows the maximum 
resolution has been achieved. Alternatively, a target 
resolution may be specified by the user 170 in request- 
ing the download of the object. The target resolution 
option allows the user to optimize the time required for 
the data transfer to meet the user's fidelity needs. If the 
user 1 70 does not require a maximum resolution of an 
object, the user can so specify, and only an intermediate 
resolution of the object is sent. This option is beneficial 
if, for example, the user 1 70 is in a hurry to view objects 
other than the one being downloaded, or the user 170 
has a computer which is not capable of viewing high 
resolutions. If the target or maximum resolution has not 
been met, another packet is sent to the user 1 70. Once 
the target is met, the data transmission is complete. 

Claims 

1. A method for creating a three-dimensional visual 
representation of an object having multiple resolu- 
tions, comprising the steps of: 

retrieving coordinates of vertices for the object; 

determining a collapse order for the vertices 
identified in the vertex list; 

reordering the vertices identified in the vertex 
list responsive to the determined collapse 
order; and 
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creating a vertex collapse list responsive to the 
collapse order where the vertex collapse list 
specifies, for a target vertex, a neighbor vertex 
to collapse to. 

2. The method of claim 1 wherein determining the col- 
lapse order comprises the steps of: 

determining a set of collapse paths; 



3. The method of claim 2 wherein computing visual 35 
distortion factors comprises the steps of: 



5. The method of claim 3 or 4 wherein the computing 
a volume change factor for the selected collapse 



path comprises: 

computing a volume of the object after collaps- 
ing the target vertex along the collapse path; 
subtracting the computed volume from a vol- 
ume of the object prior to the collapse. 

6. The method of claim 5, wherein the step of comput- 
ing a volume further comprises: 

selecting the target vertex to be an apex for a 
pyramid; 

forming a base of the pyramid from a triangle 
connecting three consecutive neighbor vertices 
to the target vertex; 

computing a volume of the pyramid; 

constructing a next pyramid from a next set of 
three consecutive neighbor vertices; 

computing a volume of the next pyramid; 

repeating the constructing a next pyramid and 
computing a volume steps for all unique three 
consecutive neighbor vertex sets; and 

summing the volumes of the pyramids to obtain 
a volume of the object. 

The method of one of claims 2 to 6 further compris- 
ing the step of receiving an input from a user spec- 
ifying a priority weight for a visual distortion factor, 
and the determining a collapse value step further 
comprises, responsive to the computed visual dis- 
tortion factors and priority weights, determining a 
collapse value for the selected collapse path. 

The method of one of claims 2 to 7 wherein, 
responsive to collapsing the next vertex to be col- 
lapsed along the corresponding collapse path, col- 
lapse paths local to the next vertex are identified 
and the computing visual distortion factors for the 
selected collapse path and the determining a col- 
lapse value for the selected collapse path steps are 
repeated only for the local collapse paths. 

The method of one of claims 2 to 8 wherein deter- 
minig a set of collapse paths further comprises: 

selecting a target vertex; 

receiving input specifying a maximum number 
of neighbor vertices for a target vertex; 

identifying a number of neighbor vertices, 
responsive to the received input; 



10 

selecting a collapse path from the set of col- 
lapse paths; 

computing visual distortion factors for the 
selected collapse path: is 

responsive to the computed visual distortion 
factors, determining a collapse value for the 
selected collapse path; 

20 

repeating selecting a collapse path, computing 
visual distortion factors, determining a collapse 
value for each collapse path; 

selecting a next vertex to be collapsed as a ver- 25 
tex having a collapse path causing the least 
visual distortion to the object; 

collapsing the next vertex to be collapsed along 
the corresponding collapse path; and 30 

repeating the above steps until a minimum res- 7. 
olution level is attained. 



computing an area change factor for the 
selected collapse path; 

40 8. 

computing an angular deviation factor for the 
selected collapse path; and 

computing a local volume change factor for the 
selected collapse path. 45 

4. The method of claim 3 wherein the computing an 
area change factor for each collapse path further 
comprises: 9. 

50 

computing an area of the object after collapsing 
the target vertex along the collapse path; and 

subtracting the computed area from an area of 
the object prior to the collapse. 55 
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determining a collapse path responsive to 
coordinates of the target vertex and an identi- 
fied neighbor vertex; 

repeating the determining step for all identified 
neighbor vertices; 

repeating the selecting a target vertex, identify- 
ing, determining, and repeating steps for a plu- 
rality of vertices. 

1 0. The method of one of claims 2 to 9 further compris- 
ing the steps of: 

responsive to selecting a collapse path, dis- 
playing the object prior to collapsing the object 
along the selected path; 

collapsing the object along the specified path; 

displaying the object after being collapsed 
along the specified path; 

responsive to receiving an input selecting the 
collapse path, storing the collapse path and 
corresponding vertex on the collapse order list 
as the next vertex to be collapsed. 

1 1 . The method of one of the preceding claims, further 
comprising receiving an input specifying a set of 
minimum vertices, and the determining collapse 
order step further comprises determining a col- 
lapse order in which the specified set of minimum 
vertices are not collapsed. 

1 2. The method of one of the preceding claims wherein 
multiple resolution levels of the object exist, further 
comprising the steps of: 

ordering the resolution levels from highest to 
lowest resolution: 

selecting a highest resolution level for collaps- 
ing; 

the determining a collapse order step com- 
prises determining a collapse order for the 
highest resolution level, wherein vertices in the 
next lowest resolution level are not collapsed; 
and 

repeating the selecting and determining steps 
for each resolution level. 

13. The method of one of the preceding claims wherein 
the vertex coordinates are associated with vertex 
attributes. 



14. The method of one of claims 2 to 10 wherein the 
vertices have coordinates in a texture map, further 
comprising the steps of: 

5 responsive to a selected collapse path collaps- 

ing a first vertex into a second vertex to create 
a new vertex, assigning the texture map coordi- 
nates of the second vertex to the new vertex; 
responsive to the first and second vertex being 

10 on an edge of a texture discontinuity, identifying 

the collapse path as a collapse path not to be 
used. 

15. The method of one of claims 2 to 10 wherein the 
15 vertices have coordinates in a normal map, further 

comprising the steps of: 

responsive to a selected collapse path collaps- 
ing a first vertex into a second vertex to create 
20 a new vertex, assigning the normal map coordi- 

nates of the second vertex to the new vertex. 

16. The method of one of claims 2 to 10 wherein the 
vertices have coordinates in a color map, further 

25 comprising the steps of: 

responsive to a selected collapse path collaps- 
ing a first vertex into a second vertex to create 
a new vertex, assigning the color map coordi- 
30 nates of the second vertex to the new vertex; 

and 

responsive to the first and second vertex being 
on an edge of a color discontinuity, identifying 
35 the collapse path as a collapse path not to be 

used. 

17. A method for displaying an object, wherein a vertex 
list and a neighbor list is stored for the object, and 

40 vertices in the vertex list are identified by a collapse 
priority, and the neighbor list identifies the path of a 
collapse for the vertices, comprising the steps of: 

performing a collapse of the object responsive 
45 to the vertex list and neighbor list; 

storing vertex information for each collapse 
level, wherein the vertex information indicates 
which vertices exist in the object in the collapse 
so level immediately higher and lower than the 

current collapse level; 

receiving input requesting a collapse level for 
the object; 

55 

responsive to the requested collapse level 
requiring a higher resolution than a current col- 
lapse level, adding vertices to the object 
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responsive to the vertex list and stored vertex 
information; 

responsive to the requested collapse level 
requiring a lower resolution than a current col- 
lapse level, collapsing vertices in the object 
responsive to the vertex list and stored vertex 
information. 



responsive to the number of polygons currently 
being displayed being less than the predefined 
number, adding polygons to the object. 

22. The method of claim 1 9 wherein the step of analyz- 
ing the object further comprises: 

determining a current frame rate; 



18. The method of claim 1 7 further comprising the step 10 
of: 



comparing the current frame rate to a prede- 
fined frame rate; and 



storing extended collapse information, wherein 
the extended collapse information includes tri- 
angle connectivity information for the vertices. 



15 



responsive to the current frame being less than 
the predefined frame rate, collapsing vertices 
in the object. 



19. A method for displaying an object, wherein a vertex 
list and a neighbor list is stored for the object, and 
vertices in the vertex list are identified by a collapse 
priority, and the neighbor list identifies the path of a 
collapse for the vertices, comprising the steps of: 



20 



23. A method for transferring data across a remote con- 
nection, in a system in which a minimal resolution of 
an object is stored and separate packets of informa- 
tion comprising data for creating higher resolutions 
of the object are stored, comprising the steps of: 



performing a collapse of the object responsive 
to the vertex list and neighbor list; 

storing vertex information for each collapse 
level, wherein the vertex information indicates 
which vertices exist in the object in the collapse 
level immediately higher and lower than the 
current collapse level; 

analyzing the object to determine a collapse 
level; 

responsive to the determined collapse level 
requiring higher resolution, adding vertices to 
the object responsive to the vertex list and 
stored vertex information; 

responsive to the determined collapse level 
requiring a lower resolution, collapsing vertices 
in the object responsive to the vertex list and 
stored vertex information. 



25 



30 



35 



40 



receiving a request for a transmission of an 
object to be displayed; 

transmitting a minimal resolution version of the 
object responsive to the received request; 

transmitting a packet of information comprising 
data for creating a next higher resolution of the 
object; 

determining whether a target resolution of the 
object has been met; and 

responsive to a target resolution of the object 
not being met, repeating the transmitting a 
packet of information comprising data for creat- 
ing a next higher resolution of the object step. 



20. The method of claim 19 or 20 wherein the step of 45 
analyzing the object further comprises: 

determining a velocity of the object; and 

determining a projected area of the object. so 

21 . The method of claim 20 wherein the step of analyz- 
ing the object further comprises: 



determining the number of polygons currently 55 
being displayed; 

comparing the determined number to a prede- 
fined target number of polygons; and 
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